Search for: All records

Accurate instrument segmentation in the endoscopic vision of minimally invasive surgery is challenging due to complex instruments and environments. Deep learning techniques have shown competitive performance in recent years. However, deep learning usually requires a large amount of labeled data to achieve accurate prediction, which poses a significant workload. To alleviate this workload, we propose an active learning-based framework to generate synthetic images for efficient neural network training. In each active learning iteration, a small number of informative unlabeled images are first queried by active learning and manually labeled. Next, synthetic images are generated based on these selected images. The instruments and backgrounds are cropped out and randomly combined with blending and fusion near the boundary. The proposed method leverages the advantage of both active learning and synthetic images. The effectiveness of the proposed method is validated on two sinus surgery datasets and one intraabdominal surgery dataset. The results indicate a considerable performance improvement, especially when the size of the annotated dataset is small. All the code is open-sourced at: https://github.com/HaonanPeng/active_syn_generator 

Abstract Background Tympanometry is used as part of a battery of tests for screening of middle ear function and may help diagnose middle ear disorders, but remains available only on expensive test equipment. Methods We report a low-cost smartphone-based tympanometer system that consists of a lightweight and portable attachment to vary air pressure in the ear and measure middle ear function. The smartphone displays a tympanogram and reports peak acoustic admittance in realtime. Our programmable and open-source system operates at 226 Hz and was tested on 50 pediatric patient ears in an audiology clinic in parallel with a commercial tympanometer. Results Our study shows an average agreement of 86 ± 2% between the 100 tympanograms produced by the smartphone and commercial device when five pediatric audiologists classified them into five classes based on the Liden and Jerger classification. Conclusion Given the accessibility and prevalence of budget smartphones in developing countries, our open-source tool may help provide timely and affordable screening of middle ear disorders. 

The presence of middle ear fluid is a key diagnostic marker for two of the most common pediatric ear diseases: acute otitis media and otitis media with effusion. We present an accessible solution that uses speakers and microphones within existing smartphones to detect middle ear fluid by assessing eardrum mobility. We conducted a clinical study on 98 patient ears at a pediatric surgical center. Using leave-one-out cross-validation to estimate performance on unseen data, we obtained an area under the curve (AUC) of 0.898 for the smartphone-based machine learning algorithm. In comparison, commercial acoustic reflectometry, which requires custom hardware, achieved an AUC of 0.776. Furthermore, we achieved 85% sensitivity and 82% specificity, comparable to published performance measures for tympanometry and pneumatic otoscopy. Similar results were obtained when testing across multiple smartphone platforms. Parents of pediatric patients ( n = 25 ears) demonstrated similar performance to trained clinicians when using the smartphone-based system. These results demonstrate the potential for a smartphone to be a low-barrier and effective screening tool for detecting the presence of middle ear fluid.